Objective psychomotor laparoscopic skills evaluation using a low-cost wearable device based on accelerometry: construct and concurrent validity study.

BACKGROUND: Motion analysis of surgical maneuvers provides useful quantitative information for the objective evaluation of the surgeons. However, surgical simulation laboratories for laparoscopic training do not usually integrate devices that help quantify the level of skills of the surgeons due to their limited resources and the high costs of new technologies. The purpose of this study is to present the construct and concurrent validity of a low-cost motion tracking system, based on a wireless triaxial accelerometer, employed to objectively evaluate psychomotor skills of surgeons during laparoscopic training. METHODS: An accelerometry system, a wireless three-axis accelerometer with appearance of wristwatch, was placed on the dominant hand of the surgeons to register the motion during the laparoscopy practice with the EndoViS simulator, which simultaneously recorded the motion of the laparoscopic needle driver. This study included the participation of 30 surgeons (6 experts, 14 intermediates and 10 novices) who performed the task of intracorporeal knot-tying suture. Using 11 motion analysis parameters (MAPs), the performance of each participant was assessed. Subsequently, the scores of the three groups of surgeons were statistically analyzed. In addition, a validity study was conducted comparing the metrics between the accelerometry-tracking system and the EndoViS hybrid simulator. RESULTS: Construct validity was achieved for 8 of the 11 metrics examined with the accelerometry system. Concurrent validity demonstrated that there is a strong correlation between the results of the accelerometry system and the EndoViS simulator in 9 of 11 parameters, showing reliability of the accelerometry system as an objective evaluation method. CONCLUSION: The accelerometry system was successfully validated. This method is potentially useful to complement the objective evaluation of surgeons during laparoscopic practice in training environments such as box-trainers and simulators.

Development of a 3D Motion Tracking System for the Analysis of Skills in Microsurgery.

Microsurgical skills of trainee surgeons have been subjectively evaluated due to the lack of technological tools. The objective of this investigation is to present the construct validity of the mitracks3D, which is a system designed to help in the objective evaluation of microsurgery trainees. To achieve this, a stereoscopic vision system records the 3D motion of two tweezers manipulated by surgeons during microsurgery training. Using motion analysis parameters (MAPs), quantitative information about their microsurgical skills and performance is obtained. For validation, 14 participants were enrolled and divided into two groups: expert microsurgeons (3 female, 2 male) and trainee surgeons (4 female, 5 male). The 3D motion tracking was acquired while the surgeons practiced with two training models: transferring objects and suture. Twelve MAPs were used to objective assessment the skill levels of each participant. Subsequent, statistical analysis was computed to compare the scores of both groups. Validation results showed statistically significant differences in 8 of the 12 MAPs and in 10 of the 12 MAPs using the transferring and the suturing models, respectively. The capability of mitracks3D to differentiate the performance of microsurgeons by analyzing their movements was shown. The mitracks3D system was successfully validated. With this system was possible to differentiate the psychomotor microsurgical skills between the two groups of surgeons. The mitracks3D system is a suitable device for the evaluation of microsurgical skills in a variety of surgical specialties that require it during the training of their residents.